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ABSTRACT 

The  maximum  likelihood  (ML)  estimator  for  time-delay  in  a  multisensor 
array  in  the  presence  of  small  phase  incoherences  is  derived.  The  structure 
obtained  is  the  canonical  ML  estimator  with  a  correction  term  to  compensate  for 
the  phase.  The  Cramer-Rao  matrix  bound  is  developed  and  used  to  evaluate  the 
standard  deviation  of  the  time-delay  estimate  (TDE)  as  a  function  of  system 
parameters  such  as  number  of  sensors,  phase  variance,  bandwidth  and 
center  frequency  of  the  source.  The  curves  indicate  a  sensitivity,  at  low  input 
SNR,  of  the  TDE  variance  to  phase  standard  deviation  and  signal  center  fre¬ 


quency. 
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I.  Introduction 

Time  delay  estimates  in  an  array  processor  environment  are  important 
quantities  for  applications  to  localization  and  tracking.  With  a  two-sensor  array, 
the  most  commonly  used  technique  is  to  process  the  received  signals  through  a 
generalized  cross-correlator  (GCC)  [1],  Several  GCC  processors,  which  optimize 
various  performance  indices,  have  appeared  in  the  literature:  the  Eckart  pro¬ 
cessor  [2],  maximum-likelihood  (ML)  or  Hannan-Thompson  processor  [6], 
Hassab-Boucher  processor  [3],  and  Wiener  processor  [5],  For  time-delay  estima¬ 
tion  (TDE)  in  a  multi-sensor  array,  the  ML  estimator  has  been  obtained  by  Hahn 
and  Tretter  [9],  where  it  was  shown  that  asymptotically  the  ML  estimate 
achieved  the  Cramer-Rao  matrix  bound.  Recently,  ML  TDE  for  multi-targets,  in  a 
multi-sensor  environment  has  also  been  studied  [12] 

For  a  two-sensor  array,  the  ML  estimator  can  be  manipulated  into  a  GCC 
structure,  details  of  which  can  be  found  in  [l].  These  results  for  the  two-sensor 
case  have  been  extended  by  Wax  [7]  to  include  a  random  phase  difference 
between  the  received  signals.  In  this  paper  we  will  extend  the  results  of  [7]  to 
the  case  of  multi-sensor  arrays.  The  single-target  situation  will  be  assumed  and 
the  ML  approach  will  be  used  in  estimating  the  delays.  In  addition  to  the  relative 
time  delays,  the  signals  at  the  receivers  are  subject  to  random  but  small  phase 
incoherences.  In  contrast  to  Wax,  who  can  integrate  out  the  random  phase  in 
the  two-sensor  situation,  we  require  a  small  phase  assumption.  In  Section  II,  we 
will  derive  the  ML  processor  with  the  assumption  of  small  phase  incoherence.  As 
will  be  seen  below,  the  phase  incoherence  requires  a  correcting  system  in  addi¬ 
tion  to  the  canonical  system  developed  in  [9,  Fig.  l].  In  Section  III,  the  Cramer- 
Rao  matrix  bound,  or  equivalently,  the  Fisher  Information  matrix  is  established 
The  Cramer-Rao  minimum  variance  of  the  TDE  for  a  special  case  is  then  derived. 
Numerical  results  in  the  form  of  standard  deviation  of  the  TDE  are  presented  in 


-3- 


Section  IV,  as  a  function  of  system  parameters  such  as  number  of  sensors,  signal 
bandwidth  and  center  frequency,  and  variance  of  the  incoherent  phases. 

II.  ML  Estimator  with  Small  Phase  Incoherences 

We  assume  that  the  analytic  signal  at  the  Ith  receiver  of  an  M-sensor  array 
can  be  modeled  by 


*i(f)  =  s(t  -  Di)e3fi  +  ni(t),  0  <  £  <  71 


(1) 


where  s(t)  and  7ij(£)  represent  the  pre-envelopes  of  the  signal  source  (target) 
and  additive  noise,  respectively.  denotes  the  time  delay  and  <Pi  is  the  phase 
incoherence.  Since  we  are  interested  in  relative  time  delays  and  relative  phase 
incoherences,  we  assume  that  Dx  =  <pi  =  0  This  model  has  been  used  in  [7],  [8], 
[11].  As  discussed  in  [8],  phase  incoherence  can  arise  from  ocean  bottom 
reflection,  variations  in  local  oscillators,  or  variations  in  the  refraction  index. 

To  facilitate  the  development,  the  usual  assumptions  are  made. 

(1)  s(t)  and  Tij (£ ),  1  <i<M  are  independent  wide-sense  stationary  Gaussian 
processes  with  zero  means. 

(2)  y>i  with  probability  density  distribution  /i($u)  is  independent  of  cpj  for  ;  *  i. 

(3)  The  observation  interval  T  is  large  compared  to  Max,  | Dt  \  plus  the  correla¬ 
tion  time  of  the  source  signal. 

With  a  development  analogous  to  that  in  [7],  we  derive  the  ML  processor  for  the 
multi-sensor  case 

Let  Xi(k )  be  the  Fourier  coefficient  of  Xi(t)  at  the  frequency  cjk,  i.e., 


(2) 
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where  ok  is  some  integer  multiple  of  Zn/T.  We  assume  that  Xi(t)  can  be 
approximated  by  a  finite  Fourier-coefficient-weighted  sum  of 
exp (jukt),  1  <  k  <:  N .  Of  course,  here  we  must  choose  the  frequency  range  cjkl 
1  :£  k  <  N  in  such  a  way  that  the  truncation  error  can  be  neglected.  To  simplify 
our  notation,  we  define 

X(k)  [*i(*)t  xz(k),  •  ■  •  ,xu{k)Y 
x£[XT(l),XT(Z),  ■  ■  ■  ,Xt{N)]t 

and 

D±[Dz,Da,  ■■■  ,  DuY 

<P  =  [<p2.  ?3.  •  ■  •  .  <PmY 


Note  that  due  to  Assumption  (3)  in  the  above,  we  obtain 

E[X{k)  X '(j)]=  V(k)6kj  ,  (3) 


where  f  denotes  conjugate  transpose  and  V{k )  is  the  covariance  matrix  for  X(k). 

That  is,  for  large  observation  time,  the  Fourier  coefficients  are  uncorrelated. 
From  Assumption  (l)  and  Eqn.  (3),  we  have  the  following  probability  density  dis¬ 
tribution. 


p(X\D,<p)  = 


rr™  n  | 

fc  =  l 


V(k) 


-1 


exp 


-t 


(4) 


With  $s(k)  and  ^(fc)  denoting  the  power  spectral  densities  at  uk  for  s(f)  and 
Tii(t),  respectively,  it  is  straightforward  to  show  from  (l)  that 


where 


V(k)  *  [$,(*)  E(k)E*(k)  +  ] 


(5) 


E(k)  = 


fc 


e  -jUk(DU-V}i) 


and 
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•M*)  =  dio^j$ni(fc),  ■  •  $nM(k) 


1  + 


£  *.(*) 


i  =  1 


/*«,(*) 


$//(*)  I .  we  can 


Now  using  the  relationship  T  |F(fc)|  = 

show  that  the  first  factor  on  the  right-hand  side  of  (4)  is  independent  of  D  and  y>. 

After  applying  the  matrix  inversion  lemma  to  V(k )  given  in  (5),  we  can  express 
(4)  with  some  tedious  but  straightforward  manipulations  as: 

p{X  |  D,  <p)  =  C,*exp  (Cg)  ,  (6) 


where  Cx  is  a  constant  independent  of  D  and  <p,  and  C2  is  given  by 


Cz=t  E^(k)^(k)%(k)^(k)  E(k)^t(k) 


k  =  1 


w  £“-/ ■£’T(w)  $/(&>)  $x{cS)$Nl(cS)E(o)  $t(o)du 


(7.a) 

(7.b) 


where  lz(*)  is  defined  as  T[X{k)  XT(A:)]  and 


$<(*)  = 


+ 1 


(k) 


i  =  1 


(8) 


Furthermore,  with 


Da  (o)  ^  diag 


e~iuDi  e S  uDz  ...  e~iuDu 


and 


•  i  e 


jfu 


we  can  rewrite  (6)  as 


p(X  |  D  ,  <p)  -  Cx  •  exp  <p  T  H{D)  tp 


where 


(9) 


H{D)  =  JL.J  D}{a)  Iz(cj)  ^(cj)  Z7.(«)  *,(«)«*» 


(10) 
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Therefore,  maximizing  the  likelihood  function  p{X  |  D)  =  E9 \p  (X  \  D,  95)}  is 
equivalent  to  maximizing  1 

Q(D)  =  E,\exp[?tH(D)  <p]\  .  (11) 

—  -«  “ 

It  may  be  difficult  to  find  an  explicit  expression  for  Q{D)  in  (11)  even  if  we 
know  the  probability  density  distribution  for  <p.  However,  if  we  assume  that  the 

phase  incoherence  between  any  two  sensors  is  small  with  large  probability,  we 
can  obtain  an  approximate  expression  for  Q(D )  as  follows.2  Let  Hy{D)  denote 

the  ij 01  element  of  the  Hermitian  matrix  H{D).  By  expanding  the  exponent  in 
(11)  and  using  the  approximation  that  exp  (a)«l  +  a  for  small  a,  we  have 

Q(D)  vexplt  i  HitiDX'EJex p[£  £  ;//*(£)  (Vk~<Pi)]l  •  (12) 

i=l  k= 1  i=l  fc=l 

Simple  manipulation  of  the  exponent  in  (12)  leads  to 

Q{D)  =  expnT  vmi-EJexplf,  tm]]  (13) 

i=2 

where  1  means  the  M-dimensional  column  vector  with  all  elements  being  unity, 
and 

ft  =  2  £ lm(tf*(r)]  (14) 

with  Im(*)  denoting  the  imaginary  part  of  a  complex  quantity.  In  deriving  (14) 
the  fact  that  H{D)  is  a  Hermitian  matrix  has  been  used  Therefore,  from  the 

independence  of  the  ^i’s,  (13)  reduces  to 

Q(D)  =  exp\l  7  H(D)1  +  f,  ln^)!  ,  (15) 

i=2 

l'  Ey\*\  designates  the  expectation  with  respect  to  cp. 

Alternatively,  we  assume  that  the  probability  densities  fi{<p)  are  highly  concentrated 
around  zero. 
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where  Mt{»)  is  the  moment  generating  function  (MGF)  for  pt.  From  (15)  we  now 
conclude  that  the  ML  estimate  of  D  can  be  obtained  by  maximizing  QX{D)  which 

is  given  by 

Q1(D)=lTH(D)l  +  fl\nMi(ti)  .  (16) 

i=2 

Note  that  the  first  term  on  the  right-hand  side  of  (16)  is  the  canonical  ML  esti¬ 
mator  discussed  in  [9,  Sec.  Ill],  However,  due  to  the  assumed  phase  incoher¬ 
ences  between  the  signals  at  the  sensors,  a  correction  term  which  is 
represented  by  the  summation  of  logarithms  of  the  phase  moment  generating 
functions  must  be  added. 

Implementation.  Here  we  want  to  construct  a  unified  system  structure, 
although  it  may  be  further  manipulated  for  particular  situations  (e.g.,  GCC 
structure  for  two-sensor  case).  Let  fii(t)  denote  the  output  signal  after  x^t)  is 
filtered  by  a  linear  system  with  frequency  response  V$t («)  e}uDi/ $  (u).  From 
(10)  we  have  the  ijth  element  of  H{D)  given  by 

T 

Hy{0  *  f  hi(t)  hf(t)dt  ,  (17) 

0 

where  *  means  complex  conjugate.  In  deriving  (17)  Parseval  theorem  and  the 
fact  that  the  Fourier  spectrum  of  x^t)/  T  at  frequency  uk  is  equal  to  ^(jfc)  in 
(2)  have  been  used  Based  on  the  relationship  (17),  the  ML  estimator  can  now 
easily  be  established  from  (16).  This  is  illustrated  in  Fig.  1.  The  multiple-input 
multiple-output  correlator  in  Fig.  1  accounts  for  the  small  phase  incoherences 
involved  at  the  sensors.  Note  that  for  the  implementation  in  Fig.  1,  we  must 
have  a  priori  knowledge  on  the  power  spectral  densities  for  source  signal  and 
sensor  noise,  and  the  moment  generating  functions  for  the  phase  incoherences. 
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In  the  following,  we  will  consider  the  Cramer-Rao  matrix  bound  for  the  ML 
TDE,  The  effect  of  phase  incoherence  on  the  variance  of  the  TDE  will  be  dis¬ 
cussed. 


El.  Cramer-Rao  Matrix  Bound  (CRMB)  for  TDE 

It  is  well-known  that  the  ML  estimate  will,  under  general  conditions,  achieve 
the  Cramer-Rao  bound  [15],  In  this  section,  we  will  consider  the  CRMB,  or 
equivalently,  Fisher  information  matrix  (FIM)  for  the  ML  TDE.  The  result,  Eq. 
(29)  below,  can  serve  as  a  guide  in  picking  the  reference  sensor. 

Let  £  =  (Dr,  (p  T)T .  Then  the  FIM  for  £  can  be  represented  by  the  following 
block  matrix 


a  /S 


FIM  (£)  = 


fa  7  +  V 


(18) 


where  the  ijth  elements  of  {M-l)x(M-l)  matrices  a,  /S.andy  are  given, 
respectively,  by 


a H  =  ~E 
fa  =  ~E 
7ij  =  ~E 


32lnp(X  |  D,  ?)/3A+i 
32lnp(Z  |  D,  (p)/dDi+1  dtpj+1 
d2lnp(X  |  D,  <p)/d<pi+1  dtpj+1 


(19  a) 
(19. b) 
(I9.c) 


eind  tj  is  an  (M- 1)  x  (M— 1)  diagonal  matrix  with  ith  diagonal  element  p*  given  by 


Vi  =  ~E^d2\nfi+x{tp)/  dtp2 


(19  d) 


Given  the  probability  density  function  of  (4),  the  derivations  of  ai;-,  fa  and 
are  straightforward,  although  tedious.  Hence,  we  omit  the  complicated  deriva¬ 
tions  and  summarize  the  results  in  the  following: 
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T  r 

«v  =  —J  u2%{u)du 
71  0 

__  T 

pij  =  —J  UTpxi{cS)du 
77  0 

and 


(20. a) 
(20. b) 


rp 

7 a  = 


(20. c) 


where,  with  <5„  denoting  the  Kronecker  delta,  ip^  (u)  is  given  by 


*<B)  =  i 3? 


VS 


(21) 


*  =  1  $n*(«)  $n>+1(w) 

Note  that  from  the  definition  of  $*(w)  in  (8),  (21)  can  be  rewritten  in  terms  of 
the  input  signal-to-noise  ratio  (SNR)  as 


V'tj(w)  =Pi+i(u) 


u 


<5i;  S  Pk(u)  ~Pj>l(w) 

fc  =  l 


/ 


i  +  2  pkW) 

k-\ 


(22) 


where  the  SNR  Pi{rJ)  at  the  Ith  sensor  is  defined  as  <f>s  (a)/  $n<(u).  When  tpi  is  nor¬ 
mally  distributed  with  zero  mean  and  variance  of  (a*  is  small  for  small  phase 
incoherence),  it  can  be  shown  that  rji  =  l/of+1. 

The  CRMB  for  TDE  can  now  be  obtained  from  the  inverse  of  FIM  (£).  Note 
that  CRMB  (D)  is  the  first  block  matrix  of  order  {M- 1)  x  (M-l)  along  the  diago¬ 
nal  of  FIM~l{().  Mathematically,  it  is  represented  by 

CRMB{D)  =  a-1  +  a"1  /S(y  +  tj  -  fFar'fi-'fPaT1  (23) 


To  further  investigate  the  effect  of  phase  incoherences  on  this  least  bound, 
we  consider  a  special  case  where  the  one-side  power  spectral  densities  for 
source  signal  and  sensor  noise  are  assumed,  respectively,  as 

$s  .  if  |w-wq|  <  W/2 


$s(u)  = 


0 


otherwise 


(u>  0) 


(24) 
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and 


*«,(*)  =  \ 


(25) 


The  assumptions  of  white  noise  and  bandlimited  source  signal  with  flat  spectrum 
allow  us  to  obtain  some  explicit  results  on  the  variance  of  the  TDE.3 

Let  Pi,  the  SNR  at  the  Ith  sensor,  be  defined  as  $s/  Also,  to  simplify  the 
notation,  we  define 


and 


2p< 

k-l 


(26) 


A  =  diag  {  p2.  p3,  •  •  •  ,  pm 


(27) 


Now  from  (20)-(27),  and  a  considerable  amount  of  mathematical  manipulation, 
we  can  obtain 


CRMB(D)  = 


(28) 


A 


1_ 

Pi 


llT  + 


IK3/  12 


(A  +  T?!??)-1  +  tf2(A  +  ^T?)-1  A  1  1  rA(A  +  T?!??)-1 


where  1  is  a  (Af-l)-dimensional  column  vector  with  all  elements  being  unity,  and 
^l.  A  are  given  by 


A  =  °  +  wZ/ 12)_1 

=  tt(1+p)  (wp  +  Wz/  12) 

1  ( TW)p  W^/ 12 

and 


A  = 


+  y  APkVk^-l 

1  k  =2  Pfc  +  *1^-1 


Note  that  the  first  two  terms  in  (28)  represent  the  CRMB  when  no  phase 

3'  The  following  results  also  fit  the  case  where  $s  (cj)  is  bandlimited  and  has  the  same  shape 
as  \(cS)  within  that  band. 
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incoherence  is  present.  More  explicitly,  from  (28),  we  have 


Vara? (A  -  A)  w  #o 


2 


(29) 


and 


COV  o?(A.  A  )  - 


Pi  W2/  12  {pi+^iVi-i)  (pj 


1_+  _ Pi£i 


PiPj 


(30) 


An  interesting  observation  from  (29)  is  that  it  may  be  advantageous  to 
choose  the  sensor  with  largest  SNR  as  the  reference  sensor  since  the  variance  of 
the  TDE  tends  to  decrease  in  general  for  larger  pv 


IV.  Numerical  Results 


We  assume  that  the  SNR  s  at  the  sensors  are  the  same  and  that  the  p4's  are 
normally  distributed  with  zero  mean  and  variance  cr2,  i.e  ,  77*  =  1/  a2.  Curves  for 
the  standard  deviation  of  the  TDE  based  on  (29)  have  been  plotted  in  Figures 
2.a-2.e  with  varying  values  of  the  following  system  parameters:  standard  devia¬ 
tion  of  the  phase  incoherence  a;  number  of  sensors  M;  observation  interval  T; 
center  frequency  of  the  source  c^,  bandwidth  of  the  source  W. 

As  expected,  the  error  variance  for  a  fixed  SNR  tends  to  decrease  as  a 
decreases  (see  Fig.  2. a).  Observe  that  in  Figure  2. a,  the  standard  deviations  at 
high  SNR  are  very  close  for  a  =  0.1  and  0.05.  In  these  cases  pt,  the  sensor  SNR, 
is  dominant  over  [see  Eqn.  (29)].  In  contrast,  for  low  input  SNR  the  error 

in  the  TDE  appears  to  be  quite  sensitive  to  the  phase  standard  deviation  a.  An 
explanation  for  this  sensitivity,  or  thresholding,  may  have  to  do  with  the  nature 
of  the  small  phase  approximation.  From  (1),  and  using  e**  «  1  +  jcp,  we  have: 


*i(0  =  s(t-£>i )  e,n  +  71*(0 

«s(f-A)  +  [tos(*-A)  +  n«(f)] 
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Both  terms  in  brackets  can  be  viewed  as  the  noise.  As  the  signal  power 
decreases,  the  first  term  tpis(t-Di)  becomes  a  more  important  contributor  to 
the  noise  power,  thus  leading  to  the  sensitivity  of  the  TDE  variance  at  low  SNR. 

It  is  interesting  to  observe  from  Fig.  2.b  that  as  M,  the  number  of  sensors 
increases,  the  error  variance  in  the  TDE  does  not  decrease  dramatically.  Since 
the  system  has  to  estimate  (^f-1)  variables,  the  TDE  uncertainty  is  not 
markedly  decreased  with  increasing  number  of  sensors. 

As  expected,  Figures  2.b-2.e  indicate  that  estimation  performance  is 
improved  as  the  quantities  M,  T,  uQ,  or  W  increase.  Fig.  2  d  is  somewhat 
surprising  in  that  the  variance  of  the  TDE  is  quite  sensitive  to  the  center  fre¬ 
quency  of  the  signal  for  low  SNR. 


V.  Summary  and  Conclusion 

The  ML  estimator  for  time-delays  in  a  multi-sensory  array  with  small  phase 
incoherences  has  been  derived  In  addition  to  the  canonical  ML  estimator  as 
developed  in  [9],  a  correcting  system  is  required  to  compensate  for  the  phase 
incoherences  The  Cramer-Rao  matrix  bound  for  ML  TDE  was  also  obtained. 
Under  the  assumptions  of  white  noise  and  bandlimited  source  signal  with  flat 
spectrum,  we  were  able  to  find  explicit  results  on  the  Cramer-Rao  minimum 
variance  for  each  TDE.  These  results  serve  as  a  guide  on  how  to  choose  the 
reference  sensor.  Curves  of  Cramer-Rao  minimum  standard  deviation  for  TDE 
were  generated  for  the  case  of  equal  input  SNR  and  identically  distributed  Gaus¬ 
sian  phase  incoherences.  As  expected,  performance  improved  for  larger 
M,  T,  cjo,  W  and  smaller  a 

As  indicated  by  the  implementation  in  Fig.  1,  the  power  spectral  densities 
for  both  source  signal  and  sensor  noise  and  also  the  probability  distribution  for 
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phase  incoherences  must  be  known  These  quantities,  in  practice,  may  have  to 
be  measured  from  input  signals  (t)  and  some  other  a  priori  knowledge.  For 
example,  with  Xi(^)  denoting  the  Fourier  transform  of  xi( t ),  we  may  have  to  use 
the  estimates 


(31) 

(32) 


ijtj 

$kt(«)  =  IXi(u)l2/  T  -  $s(cj) 


It  has  been  shown  in  [9]  that,  when  there  is  no  phase  incoherence,  it  is  pos¬ 
sible  to  solve  this  multiple  TDE  problem  by  applying  a  GCC  system  to  every  pos¬ 
sible  pair  of  sensors;  with  appropriate  filters  in  each  GCC  system,  this  approach 
does  not  degrade  the  covariance  matrix  bound  obtained  for  ML  TDE.  It  is  not 
known  whether  or  not  there  is  a  corresponding  formulation  when  the  phase 
incoherences  are  present.  This  is  an  interesting  topic  for  further  investigation. 
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Figure  1  -  Implementation  of  Maximum-Likelihood 
Time-Delay  Estimator 
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Figure  2a  -  Standard  deviation  of  TDE  vs.  input  SNR  for  various  n\ 
M  =  10,  T  60  seconds ,  c>o/2n  =  8  KHz ,  W/  2v  —  4  KHz 


r~ 


Figure  Zb  -  Standard  deviation  of  TDE  vs.  input  SNR  for  various  /»'; 
a  =  0.03,  T  =  30  seconds ,  cj0/  277  =  3  KHz ,  F//  2rr  =  4  KHz  . 
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Figure  2d  -  Standard  deviation  of  TDE  vs.  input  SNR  for  various  cjg ; 
o  -  0  03,  M  -  10,  T  -  60  seconds  ,  W /  2n  -  4  KHz  . 
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Figure  2e  -  Standard  deviation  of  TDE  vs.  input  SNR  for  various  V/ ; 
a  =  0.03,  M  =  10,  T  =  60  seconds ,  cj0/2tt  =  B  KHz . 
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